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BACKGROUND OF THE INVENTION 
5 As is known in the art, a network processor is a programmable hardware device 

designed to process packets in a packet switching network at high speed. Network processors 
typically differ from other processors in that network processors include hardware that can 
rapidly perform protocol processing tasks. 

10 As is also known, there is a trend to provide network processors which perform 

cryptographic processing of packet data. To facilitate the cryptographic processing, the 
network processors include cryptographic acceleration units (also referred to as "crypto units"). 
The crypto units accelerate the cryptographic processing of packet data to support 
cryptographic processing at line rate. One example of a network processor including a crypto 

15 unit is the Intel® IXP2850 network processor manufactured by Intel Corporation, 2200 Mission 
College Blvd. Santa Clara, CA 95052 USA. 

Two types of cryptographic processing that are commonly performed on packet data are 
authentication processing (or more simply authentication) and ciphering processing (or more 
2 0 simply ciphering). Authentication is the process of creating a digest of the packet, which is sent 
along with the packet, and allows the receiver to verify that the packet was indeed sent by the 
sender (rather than by some third party) and was not modified in transit. Ciphering is the 
process of encrypting the packet, so that only the intended receiver, with the correct 
cryptographic key, can decrypt the packet and read its contents. The most commonly used 

2 5 security protocols perform both ciphering and authentication on each packet. 

In order to support the ciphering of relatively small packets, the crypto units in the 
Intel® IXP2850 each have six processing contexts, which are each used to process one packet 
at a time. Each processing context contains storage for the cipher keys and algorithm context 

3 0 associated with the processing of one packet. Multiple processing contexts allow the latency of 
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loading cryptographic key material and packet data to be hidden by pipelining the loading of 
data and key material into some of the contexts with the processing of data in other contexts. 
This allows the crypto unit to achieve close to fall utilization of the cipher and authentication 
cores. 

5 The crypto units in the Intel® EXP2850 implement the 3DES and AES cipher 

algorithms as well as the SHA1 authentication algorithm. Each of the crypto units contains a 
single AES core and a pair of 3DESand SHA1 cores because the structure of those algorithms 
make it difficult for a single core to operate at the required data rates. By implementing a pair 
of cores and allowing both cores to process data in parallel, the crypto units meet desired data 
1 0 rate requirements. This approach, however, presents a problem of how to schedule the 
operation of the individual cores within a pair. 

There are several ways to solve this problem. For example, the contexts within a crypto 
unit can be divided into two groups and the each of the cores in a pair can be assigned to 
15 process requests from a group of contexts. Since the programmer controls which packets are 
processed by which processing context, this approach pushes the problem of load balancing 
work between the individual cores in a pair to the programmer. 

For example, in a 3DES crypto unit the programmer must ensure that half of the packets 
20 requiring processing by the 3DES algorithm are assigned to one of the contexts serviced by one 
3DES core, and the other half of the packets requiring processing by the 3DES algorithm are 
assigned to one of the contexts serviced by the other 3DES core. 

BRIEF DESCRIPTION OF THE DRAWINGS 
25 The foregoing features of the invention, as well as the invention itself may be more fully 

understood from the following detailed description of the drawings, in which: 

FIG. 1 is a block diagram of an exemplary network processor having a scheduler and a 
pair of same context command first-in-first-out (FIFO) queues coupled to respective ones of a 
pair of cores; 

3 0 FIG. 2 is a flow diagram which illustrates a state machine for one of the cores; 
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FIG. 3 is a flow diagram which illustrates a command scheduling technique associated 
with cores in a processor; 

FIG. 4 is a block diagram of a system which includes a network processor which utilizes 
the scheduling technique described in conjunction with FIG. 3; 
5 FIG. 5 is a block diagram of a portion of an exemplary network processor having 

cryptographic processing units at least one of which includes a scheduler and a pair of same 
context command first-in-first-out (FIFO) queues coupled to respective ones of a plurality of 
cores; 

FIG. 5A is a block diagram showing additional details of one of the cryptographic 
1 0 acceleration units in the network processor of FIG. 5. and 

FIG. 5B is a block diagram of a processor having a cryptographic acceleration unit 
which includes a single scheduler and command FIFO. 

DETAILED DESCRIPTION OF THE INVENTION 

15 An exemplary embodiment of a network processor which performs encryption and 

decryption operations on incoming data packets is described. Numerous details are set forth 
below in order to provide a thorough understanding of the scheduling techniques and related 
apparatus used to process the packets. It should be apparent to one skilled in the art that 
variants of the below described techniques and apparatus may be used in other embodiments 

2 0 without deviating from the spirit and scope of the concepts described herein. For example, the 
concepts described below can be implemented in a security processor or other type of 
processor. Also, it should be appreciated that in some instances, well-known circuitry is not set 
forth in detail in order to promote conciseness and clarity in the description of the figures. 

2 5 Referring now to FIG. 1 , an exemplary network processor 1 0 includes a command first- 

in-first-out (FIFO) queue 12 coupled to a scheduler 14. It should be appreciated that FIFO 12 
may be provided as any type of buffer which preserves the order of commands provided thereto. 
Commands exit the structure 12 in the same order in which they entered the structure 12. 

3 0 The scheduler 14 receives commands from the command FIFO 12 and assigns the 
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processing of the commands to one of a pair of cores 16a, 16b within a cryptographic 
acceleration unit 17 (also referred to as "crypto unit 17"). Each of the cores 16a, 16b has 
coupled thereto a same-context-command FIFO queue 18a, 18b. 



5 The cores 16a, 1 6b form a core group 1 9. It should be understood that although in the 

exemplary embodiment of FIG. 1, the core group 19 is comprised of two cores 16a, 16b, in 
other embodiments the core group can be provided from any number of cores. The maximum 
number of cores which can be included in a core group is limited only by practical 
manufacturing considerations. 

10 

It should be appreciated that in preferred embodiments, the command FIFO 12 and scheduler 
14 are provided as part of the crypto unit 17 and they receive commands from a global 
command FIFO and a global command scheduler provided as part of a processor (e.g. a 
network processor) of which the crypto unit 17 is also a part. One example of such an 

15 embodiment is described below in conjunction with FIG. 5 A. 

It should also be appreciated that the plurality of cores 16a, 16b can be adapted to 
process commands from any algorithm having a structure which makes it difficult for a single 
core to operate at desired or required data rates. For example, in one embodiment in which 
3DES commands are processed, the cores 16a, 16b correspond to a pair of 3DES cores 16a, 16b 

20 (cores 16a, 16b also referred to herein as "core 0" and "core 1," respectively). Thus, in this 
case, the command FIFO 12 would correspond to a 3DES Command FIFO 12 and the 
commands for 3DES processing would be queued in the 3DES Command FIFO 12. Similarly, 
the same-context-command FIFOs 18a, 18b would correspond to 3DES same-context- 
command FIFOs 18a, 18b. 

25 

In another embodiment in which MD5 commands are processed, the cores 16a, 16b 
correspond to a pair of MD5 cores 16a, 16b. Thus, in this case, the command FIFO 12 would 
correspond to an MD5 command FIFO 12 and the commands for MD5 processing would be 
queued in the MD5 command FIFO 12. Similarly, the same-context-command FIFOs 18a, 18b 
3 0 would correspond to MD5 same-context-command FIFOs 1 8a, 1 8b. 
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In yet another embodiment in which SHA1 commands are processed, the cores 16a, 16b 
correspond a pair of SHA1 cores 16a, 16b. Thus, in this case, the command FIFO 12 
corresponds to a SHA1 command FIFO 12 and the commands for SHA1 processing are queued 
5 in the SHA1 command FIFO 12. Similarly, the same-context-command FIFOs 18a, 18b would 
correspond to SHA1 same-context-command FIFOs 18a, 18b. 

In view of the above, it should be understood that although only one pair of cores (i.e. 
one core group 19) is shown in FIG. 1, a practical network processor is likely to include 

10 multiple pairs of cores (i.e. multiple core groups) with associated same context command 
FIFOs with each of the pairs adapted to process one of a plurality of different cipher and 
authentication algorithms. A practical network processor is also likely to include a global 
command FIFO queue and global command scheduling logic (e.g. a global command 
scheduler) to direct commands to a particular one of a plurality of command FIFOs for a 

15 particular core group (e.g. command FIFO 12 for core group 19). 

Assuming that cores 16a, 16b each correspond to 3DES cores, and that core 16a 
completes processing a command, then core 16a checks to see if there are any commands 
waiting in its same-context-command FIFO 18a. If there are, then core 16a processes the 
2 0 command at the head of the Same-context-command FIFO 1 8a. If the FIFO 1 8a is empty, then 
3DES Core 0 16a indicates to the scheduler 14 that it is idle. The scheduler then checks to see 
if there are any commands in the 3DES Command FIFO 12. If there are, then the scheduler 14 
checks to see if the context specified with the command at the head of the FIFO 12 corresponds 
to the context of the command being processed by 3DES core 1 16b. If the contexts are the 

2 5 same, the command is queued in the same-context-command FIFO 1 8b associated with 3DES 

core 1 16b and the scheduler performs the same process on the next command in the 3DES 
command FIFO. 

If the context specified in the command at the head of the 3DES Command FIFO 12 is 

3 0 not the same as the context of the command being processed by 3DES Core 1 1 6b, or if the 
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3DES Core 1 16b is idle, the scheduler 14 can give the command at the head of the 3DES 
command FIFO 12 to either the 3DES core 0 16a or the 3DES core 1 166. Assuming that in 
response to such a condition (i.e. both cores 16a, 16b and idle) that the scheduler assigns the 
command to core 16a, then the 3DES core 16a begins processing the command. Because 
5 commands are assigned to be processed by a core only when the core has become idle, the 
scheduler 14 achieves load balancing between the cores 16a, 16b. 



It should be appreciated that although the exemplary embodiment of FIG. 1 is described 
in the context of 3DES cores and algorithms, this same scheduling structure can be used if the 
10 cores 16a, 16b corresponded to a pair of MD5 cores or a pair of SHA1 cores. It should also be 
appreciated that although the technique is described in FIG. 1 as implemented for pairs of 
algorithm cores (e.g. a pair of 3DES cores), the technique also applies to the scheduling of any 
number of algorithm cores (e.g. three or more cores). 

15 It should also be understood that although in a preferred embodiment, each core 

included within a core group is identical, this need not be so. That is, each core in a core group 
may have different processing characteristics. In the case where one core has a faster 
processing characteristic than another core within a core group, the scheduler 14 will 
automatically handle the load balancing between each core in the core group. The only 

2 0 requirement for a core group is that each core within the group be processing the same 
algorithm. 



Referring now to FIG. 2, a state diagram for one of the cores shown in FIG. 1 (i.e. either 
core 16a or 16b) includes three states. The core is initially in an idle state 20. In response to a 

25 command received from a scheduler, the core moves along transition 22 to a processing 
command state 24 in which the core processes the command. From state 24, once the core 
completes processing the command, if a same-context-command FIFO associated with the core 
does not hold a command, the core proceeds back to idle state 20 (along transition 32). If, on 
the other hand, the core's same-context-command FIFO holds a command, then the core 

3 0 proceeds to state 28 (along transition 26), in which the command is de-queued from the same- 
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context-command FIFO and the core returns to state 24 (along transition 30) where the de- 
queued command is processed. Once the core has processed all commands and its same 
context command FIFO is empty, the core returns to its idle state 20 (along transition 32). 



5 FIG. 3 illustrates a command scheduling technique associated with cores in a processor 

(e.g. a network processor or a security processor), which includes one or more groups of cores 
to process packets. It should be understood that although the processing described in 
conjunction with FIG. 3 below assumes that the group of cores is comprised of two cores 
(referred to as first and second core in FIG. 3), it is recognized that the concepts and techniques 
10 described in conjunction with FIG. 3 apply regardless of the specific number of cores within the 
group of cores and regardless of the number of core groups. Thus, processor can include any 
number of core groups and each of the core groups can include any number of cores. 



The rectangular elements in the flow diagram (typified by element 42 in FIG. 3), are 
15 herein denoted "processing blocks" and represent computer software instructions or groups of 
instructions. The diamond shaped elements (typified by element 44 in FIG. 3) are herein 
denoted "decision blocks" and represent computer software instructions, or groups of 
instructions which affect the execution of the computer software instructions represented by the 
processing blocks. 

20 

Alternatively, the processing and decision blocks represent processing steps performed 
by functionally equivalent circuits. The flow diagram does not depict the syntax of any 
particular programming language. Rather, the flow diagram illustrates the functional 
information one of ordinary skill in the art requires to fabricate circuits or to generate computer 
2 5 code to perform the processing required of the processor. It should be noted that many routine 
program elements, such as initialization of loops and variables and the use of temporary 
variables are not shown. It will be appreciated by those of ordinary skill in the art that unless 
otherwise indicated herein, the particular sequence of steps described is illustrative only and can 
be varied without departing from the spirit of the invention. 
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It should be appreciated that in the description of FIG. 3 , it is assumed that a crypto unit 
includes two cores and that if both cores are idle, the scheduler will assign the next command to 
whichever core is identified as the first core of the two cores (e.g. the core identified as core 0 
in FIG. 1). 

Turning now to FIG. 3, processing begins at block 42 where the system waits until 
either a core goes idle or until a command is received. When either of these conditions is found 
to exist, a determination is made as to which condition (i.e. an idle core condition or a 
command received condition) has occurred. In the flow diagram of FIG. 3 this is done in 
decision block 44 by determining whether a core has entered an idle state. In a system having a 
pair of cores (e.g. cores 16a, 16b in FIG. 1), a check is made to determine whether either of the 
cores has gone idle. 

A determination of whether an idle core condition or a command received condition has 
occurred could also be made by checking if a command has just arrived into the command 
FIFO (i.e. rather than checking to see if a core has entered an idle state). Other techniques 
could also be used to make the same determination. 

If in decision block 44, a decision is made that a core has gone idle, then processing 
proceeds to decision block 46. For the purposes of the remainder of this flow diagram, it is 
assumed that it is the first core in the core group which has gone idle (e.g. core 16a in FIG. 1). 
In decision block 46, the scheduler 14 checks to see if there are any commands in a command 
FIFO (e.g. command FIFO 12, FIG. 1). If no commands are in the command FIFO 12, then 
processing returns to step 42. 

If in decision block 46 the scheduler 14 finds a command in the command FIFO 12, 
then processing proceeds to decision block 48 in which a decision is made as to whether the 
second core (e.g. core 16b in FIG. 1) in the group of cores is idle. If the second core is idle, 
then the command in the command FIFO is de-queued from the command FIFO and is assigned 
directly to the first core for processing. 
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If in decision block 48, a decision is made that the second core (e.g. core 16b) is not 
idle, then processing proceeds to decision block 50 in which a decision is made as to whether 
the context of the command in the command FIFO is the same as the context of the command 
5 currently being processed by the second core. That is, the scheduler checks to see if the context 
specified within the command at the head of the command FIFO corresponds to the context of 
the command being processed by the second core. 



If the context is the same, then processing proceeds to decision block 52 in which a 
10 decision is made as to whether the same-context-command FIFO (e.g., same-context-command 
FIFO 18b, FIG. 1) is full. If the same-context-command FIFO (e.g. same-context-command 
FIFO 18b in FIG. 1) is full, then the command is left in the command FIFO and processing 
returns to step 42. 

15 If the same-context-command FIFO for the second core is not full, then the command is 

queued in the same-context-command FIFO for the second core as shown in block 54. 
Processing then flows back to block 42. FIG. 3 assumes that new commands arrive and cores go 
idle only when the scheduler is in processing block 42. In an actual implementation, these 
events can occur at any time and the scheduler has to remember that they occurred to trigger the 

2 0 appropriate actions when the scheduler returns to processing block 42. 

If in decision block 48, a decision is made that the context specified in the command at 
the head of the command FIFO is not the same as the context of the command being processed 
by the second core, then processing proceeds to processing block 56 in which the scheduler 

2 5 gives the command at the head of the command FIFO to the first core and the first core begins 

processing the command. Processing then flows back to block 42. 

Returning to step 42, an alternate path can be followed. If processing flows to 
processing block 44 due to the arrival of a command (rather than a core going idle), then 

3 0 processing proceeds to decision block 60 in which a determination is made as to whether there 
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are commands in the command FIFO. If there are already one or more commands in the 
command FIFO, the command is merely queued to the command FIFO at processing block 58 
and the process returns to step 42. 

5 However, if there are presently no commands in the command FIFO, the process 

continues to block 62 in which a decision is made as to whether either the first or the second 
cores (e.g. either of cores 16a, 16b in FIG. 1) is currently idle. If neither core is idle, the 
process returns to step 42. If one or both of the cores are idle, the process proceeds to step 48 
and continues as described above. If both cores are idle the scheduler automatically selects the 
1 0 first core to be the idle core to which a command will be assigned. 

It should be noted, however, that the scheduler could be arranged so that when it finds 
both cores idle, it automatically assign a command in the command FIFO to the second core. 
That is, in the case where more than one core within a core group is idle, the scheduler can 
15 assign the command to any of the idle cores. Thus, as noted above, in the case where both first 
and second cores (e.g. first and second cores 16a, 16b) are idle, the scheduler can assign the 
command to either core in processing block 56. In a practical systems, however, for simplicity, 
in the case where more than one core is idle, the command is always assigned to a 
predetermined one of the cores, i.e., a default core. 

20 

For the purposes of the remainder of this diagram it is assumed that the first core is idle 
or is selected in the case that both cores are idle. 

With this technique, because commands are assigned to be directly processed by a core 

2 5 only when the core has become idle, bypassing a corresponding same-context-command FIFO, 

the scheduler achieves load balancing between the pair of cores (e.g. the scheduler 14 achieves 
load balancing between the cores 16a, 16b in FIG. 1). 

As mentioned above, the processing described in conjunction with FIG. 3 assumes that 

3 0 the group of cores is provided from two cores (e.g. cores 16a, 16b describe above in 
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conjunction with FIG. 1). It should be appreciated, however, that in the case where the group of 
cores includes more that two cores, the processing in decision blocks 48, 50, 52, and 54 must be 
done for each of the cores in the group before the command in the command FIFO can be 
assigned to one of the cores in the group. In this case, the scheduler achieves load balancing 
5 between all of the cores in the group of cores. 



Referring now to FIG. 4, an exemplary network 70 includes a plurality of interconnected 
networks nodes of which four network nodes 72a - 72d are shown. Taking network node 70a 
as exemplary of one or more of the network nodes 70b-70d, network node 70a includes a router 
10 74 which in turn includes a line card switching device 76 (or more simply a line card 76). The 
line card 76 includes a network processor 78 having a network processor crypto unit which 
includes one or more core groups with each of the core groups having two or more cores and 
with each of the two or more cores having an associated same-context command FIFO as 
described above in conjunction with FIGs. 1-3. 

15 

The network processor 78 thus forms part of a line card 76 within the switching device 
74. The switching device 74 can be coupled to the other network nodes 70b - 70d, in a manner 
well known in the art. 



20 It is understood that the switching device can be provided from a variety of devices that 

include cryptographic data processing, such as a network router. Various network applications, 
configurations, switching devices, and topologies for the network and network processor will 
be readily apparent to one of ordinary skill in the art. 



25 Referring now to FIG. 5, an exemplary network processor 100 includes a crypto system 

102 having first and second cryptography acceleration units 102a, 102b (crypto units 102a, 
102b). Crypto units 102a, 102b transmit data in blocks to a Media Switch Fabric (MSF) unit 
104 via an alignment buffer. The MSF unit 104 handles the transmission of data over an 
interface 108, such as an SPI4.2/NPSI interface. It is understood that to promote 

3 0 comprehension and clarity in this description, components of the network processor 100 not 
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relevant to the features described herein may not be shown or described. The crypto units 102a, 
102b accelerate the cryptographic processing of packet data to support crypto processing at line 
rate. In operation, data is processed by the crypto units 102a, 102b and the ciphered data is 
aligned and then sent to the MSF unit 104 for transmission over the interface 108. 

In an exemplary embodiment, the crypto system 102 implements the following cipher 
algorithms: 3DES/DES, AES, and RC4. The 3DES/DES and AES algorithms are block cipher 
algorithms, which means that they process data in discrete blocks and the RC4 algorithm is a 
stream cipher that processes data one byte at a time. In one particular embodiment, the crypto 
units 102a, 102b each implement the following well-known authentication algorithms: MD5, 
SHA1, and AES-XCBC-MAC, which are block-oriented algorithms. 

Referring now to FIG. 5 A in which like elements of FIG. 5 are provided having like 
reference designations, the network processor 100 includes a global command FIFO queue 110 
which receives commands provided to the network processor 100 and provides the commands 
to a global command scheduler 1 12. The global command scheduler 1 12 directs at least some 
of the commands provided thereto to a particular one of the plurality of crypto units 102a, 102b. 

Taking crypto unit 102a as exemplary of crypto unit 102b, in the embodiment shown in 
FIG. 5 A, each of the crypto units 102a, 102b contains a plurality of core groups 1 19a, 1 19b, 
1 19c. Core group 1 19a contains a pair of 3DES/DES cores and associated same-context 
command FIFOs (SCC FIFOs). Core group 1 19b contains a pair of SHA1 cores and associated 
SCC FIFOs and core group 1 19c contains a single AES core. 

When the global command scheduler 1 12 has a command for the 3DES/DES cores in 
core group 1 19a, the global scheduler 1 12 directs the commands to the crypto unit 102a. A 
core group command FIFO 120a within crypto unit 102a receives the commands and provides 
the commands to a 3DES/DES core group scheduler 122a also within the crypto unit 102a. The 
3DES/DES core group scheduler 122a receives commands from the command FIFO 120a and 
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assigns the processing of the commands to one of the pair of 3DES/DES cores within the core 
group 119a. 

Similarly, when the global command scheduler 112 has a command for the SHA1 cores, 
5 the global scheduler 1 12 directs the commands to the core group command FIFO 120b which 
provides the commands to a SHA1 core group scheduler 122b. The SHA1 core group 
scheduler 122b receives commands from the command FIFO 120b and assigns the processing 
of the commands to one of the pair of SHA1 cores within the cryptographic acceleration unit 
102a. Thus, the global command FIFO queue 1 10 receives commands provided to the network 
1 0 processor 1 00 and then directs commands to a particular one of the plurality of core group 
command FIFOs contained within the crypto units 102a, 102b for processing by a particular 
core group via the global scheduler 112. 

Referring now to FIG. 5B, it should be appreciated that in a preferred embodiment, each 
15 of the crypto units 102a, 102b can include a queue and scheduler.. In such an embodiment, a 
cross unit scheduler 113 (which may be implemented in software or hardware) schedules the 
use of the two crypto units 102a, 102b. The scheduler 1 12' within each crypto unit gives 
commands to the core groups 1 19a, 1 19b, 1 19c depending upon the algorithm that is required to 
process a received packet (e.g. packets which must be processed using 3DES/DES are provided 
20 to core group 1 19a, packets which must be processed using SHA1 are provided to core group 
1 19b, and packets which must be processed using AES are provided to core group 1 19c). Thus, 
the processor may be implemented in such a manner that the cross unit scheduler handles the 
scheduling between the plurality of crypto units and the FIFO 110' and scheduler 1 12' are 
provided as part of each of the crypto units and simply provide commands to the appropriate 

2 5 core group within the crypto unit. It should thus be appreciated that the scheduling techniques 

described above in conjunction with FIGs. 1-3 above may be utilized regardless of the 
particular manner in which the scheduling hardware is implemented. 

While the embodiments described herein are primarily shown and described in 

3 0 conjunction with a network processor having a crypto unit with only two cores (i.e. one core 
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group), it is understood that embodiments are applicable to network processors in general. For 
example, it will be appreciated that any number of crypto units, each having any number of core 
group (and each core group having any number of cores) can be used without departing from 
the scope of the present embodiments. In addition, the number of cipher and authentication 
cores and processing contexts, as well as the supported algorithm types, can vary without 
departing from the scope of the present embodiments. 

All references cited herein are hereby incorporated herein by reference in their entirety. 

Having described preferred embodiments which serve to illustrate the inventive 
concepts, it will now become apparent to one of ordinary skill in the art that other embodiments 
incorporating their concepts may be used. It is felt therefore that these embodiments should not 
be limited to disclosed embodiments, but rather should be limited only by the spirit and scope 
of the appended claims. 

What is claimed is: 
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